CLAIMS 

What is claimed is: 

1 . A method for encoding a video sequence, said video sequence comprising a 
background composite and foreground regions, comprising the step of: 

5 encoding said video sequence based on balancing bits per pixel for said background 

composite with bits per pixel for said foreground regions. 

2. A method as in claim 1 , wherein said bits per pixel for said background composite is 
based on a number of bits in a compressed background composite, a number of bits for warp 

1 0 points of said background composite, and a number of pixels in said background composite. 

3. A method as in claim 1 , wherein said bits per pixel for said foreground regions is 
based on a number of bits in compressed foreground regions, a number of bits for shape of said 
foreground regions, and a number of pixels in said foreground regions. 

15 

4. A method as in claim 1 , wherein said bits per pixel for said background composite 
and said bits per pixel for said foreground regions are related by a balancing factor. 

5 . A method as in claim 4, wherein said balancing factor comprises a correction factor. 

20 

6. A method as in claim 4, wherein said balancing factor comprises a quality factor. 
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7, A method as in claim 1, wherein said bits per pixel for said background composite is 
based on a number of bits in a compressed background composite, wherein said bits per pixel for 
said foreground regions is based on a number of bits in compressed foreground regions, and 
wherein said number of bits in said compressed background composite and said number of bits 

5 in said compressed foreground regions are related to a bit budget. 

8. A method as in claim 1, wherein said step of encoding comprises the step of: 
determining a background quantization step for said background composite based on a 

number of bits for a compressed background composite and an actual number of bits for said 
1 0 compressed background composite. 

9, A method as in claim 8, wherein said step of determining said background 
quantization step comprises the step of: 

encoding said background composite iteratively to obtain said actual number of bits for 
1 5 said compressed background composite. 

10. A method as in claim 8, wherein said step of determining said background 
quantization step comprises the step of: 

determining an estimated background quantization step based on an estimated number of 
20 bits for said compressed background composite and said number of bits for said compressed 
background composite, wherein said step of determining said background quantization step is 
further based on said estimated background quantization step. 
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11. A method as in claim 1, wherein said step of encoding comprises the step of: 
determining a starting foreground quantization step for said foreground regions based on 
a background quantization step for said background composite and a desired bit rate. 

5 12. A method as in claim 1, wherein said step of encoding comprises the step of: 

determining estimated frame dropping for encoding of said foreground regions. 

13. A method as in claim 12, wherein said step of deterniining said estimated frame 
dropping is based on a bit budget and a temporal sub-sampling. 

10 

14. A method as in claim 12, wherein said step of encoding further comprises the step of: 
determining a background quantization step for said background composite based on said 

estimated frame dropping and an actual number of bits for said compressed background 
composite. 

15 

15. A method as in claim 1, further comprising the steps of: 

determining estimated frame dropping for encoding of said foreground regions; and 
determining actual frame dropping for encoding of said foreground regions; and 
if said actual frame dropping differs from an estimated frame dropping, determining said 
20 background quantization step based on said actual frame dropping. 

1 6. A computer system for performing the method of claim 1 . 
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17. A computer-readable medium having software for performing the method of claim 1 . 

18. An apparatus for encoding a video sequence, said video sequence comprising a 
background composite and foreground regions, comprising: 

means for encoding said video sequence based on balancing bits per pixel for said 
background composite with bits per pixel for said foreground regions. 

19. A method for encoding a video sequence, said video sequence comprising a 
background composite and foreground regions, comprising the steps of: 

determining a background quantization step for said background composite based on a 
number of bits for a compressed background composite and an actual number of bits for said 
compressed background composite; 

encoding said background composite based on said background quantization step; 

determining a starting foreground quantization step for said foreground regions based on 
said background quantization step and a desired bit rate; and 

encoding said foreground regions based on said starting foreground quantization step. 

20. A method as in claim 19, wherein said step of determining said background 
quantization step comprises the step of: 

encoding said background composite iteratively to obtain said actual number of bits for 
said compressed background composite. 
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21. A method as in claim 19, wherein said step of determining said background 
quantization step comprises the step of: 

determining an estimated background quantization step based on an estimated number of 
bits for said compressed background composite and said number of bits for said compressed 
5 background composite, wherein said step of determining said background quantization step is 
further based on said estimated background quantization step. 

22. A method as in claim 19, further comprising the step of: 

determining estimated frame dropping for encoding of said foreground regions, wherein 
1 0 determining said background quantization step is further based on said estimated frame 
dropping. 

23. A method as in claim 22, wherein said step of determining said estimated frame 
dropping is based on a bit budget and a temporal sub-sampling. 

15 

24. A method as in claim 22, further comprising the steps of: 

detemining actual frame dropping for encoding of said foreground regions; and 
if said actual frame dropping differs from said estimated frame dropping, re-determining 
said background quantization step based on said actual frame dropping. 

20 

25. A computer system for performing the method of claim 19. 
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26. A computer-readable medium having software for performing the method of claim 

19. 

27. An apparatus for encoding a video sequence, said video sequence comprising a 
5 background composite and foreground regions, comprising: 

means for determining a background quantization step for said background composite 
based on a number of bits for a compressed background composite and an actual number of bits 
for said compressed background composite; 

means for encoding said background composite based on said background quantization 

10 step; 

means for determining a starting foreground quantization step for said foreground regions 
based on said background quantization step and a desired bit rate; and 

means for encoding said foreground regions based on said starting foreground 
quantization step. 

15 

28. An apparatus as in claim 27, further comprising: 

means for determining estimated frame dropping for encoding of said foreground regions, 
wherein said means for determining said background quantization step is further based on said 
estimated frame dropping. 

20 

29. A method as in claim 28, further comprising the steps of: 

means determining actual frame dropping for encoding of said foreground regions; and 
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means for re-determining said background quantization step based on said actual frame 
dropping if said actual frame dropping differs from said estimated frame dropping. 
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